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Automata for Context-Free Languages 


Language class | Syntax/Grammar Automata 
Regular regular expressions, DFA, NFA, NFA) 
regular grammar 

Context-free context-free grammar i 


e DFA, NFA, NFA): finite states = finite memory, e.g. 
— even or odd number of a's read: two states even, odd 
— the last 2 letters read: four states for aa, ab, ba, bb. 


e Problem: languages like (a"b" | n > 0) need unbounded memory. 
A DFA with k states can only "count to k”. 


e Solution: extend NFA) by adding memory 
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Automata for Context-Free Languages 


Various simple memory models are possible: 


e Queue: First in, first out (like waiting in line) 
e Stack: Last in, first out (like a laundry basket) 


push pop 
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Stack Memory 


A stack can be described as a word over the stack alphabet I: 

e Empty stack is A. 

e push(X, YZZY) = XYZZY, push a new element on top (note 
top=left). 

e pop(YZZY) = ZZY, remove the top element. 

e top(YZZY) = Y, look at the top element. 

Note: the empty stack has no top. 
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Pushdown Automaton 


A pushdown automaton (PDA) is an NFA, with a stack. 
e An NFA, transition looks like this: 


sed e (8) —(«) 


e A PDA adds (optional) stack elements to pop and push: 


INPUT |. POP PUSH 


Md 
(B) epaA) o 
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PDA example 1 


a,A/A b, A/A 


o = o 
start qo 


Computations: always start with the empty stack; accept if we end up in 
an accepting state with an empty stack. 


e (q0,A,A) > (q1, à, A)“ (SUCCESS) 


qo, aabb, A} — (qo, abb, A) — (qo, bb, AA) —> 
aob AA) san 5 40 lAa SUES 


qo, aba, X) — (qo, ba, A) — (qi, ba, A) > (q1, a, )O (STUCK) 
qo, aba, À) — (q1, aba, A)© (STUCK) 


L= {a"b" | n > 0} 5 A, ab,aabb,... 


( 
( 
( 
( 
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Pushdown Automaton 


Def. A pushdown automaton (PDA) M = (Q, 2,1, ô, qo, F} consists 
of 


e afinite set of states Q 

e aninput alphabet X 

e an initial state qọ € Q 

e aset of final states F C Q 
e astack alphabet [ 


e a transition function ô: Q x X4 x Ta > P(Q x Fy) 
where X4 = LU {A} and a =U {A}. 
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Pushdown Automaton Computation 


A computation of a PDA M on input word w: 


e Start configuration (qo, w, À) 
(start in initial state with empty stack) 


e Transitions are taken (nondeterministically) depending on 
— the next input symbol (as in DFA, NFA) and 
— the stack top symbol. 
Changes configuration (q, w, o) — (q', w', o) according to 
transition function 

e Computation is successful if it ends in a configuration 
(q, A, A) where q € F. 
(Acceptance by final state and empty stack) 


10/31 iCIS | Software Science 
Radboud University 


Language Accepted by a PDA 


Def. The language accepted by a PDA M is: 


£(M) = {w € X* | (qo, w, A) > (q, À, à}, a E F}. 


...where (qo, w, A) = (q, A, A) means: 


(qo, w, A) — (q, w, a) eem (q, A, A) 


The stack starts empty and must finish empty. 
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PDA example 2 


L={wew® € {a,b,c}* | w € (a, b)*) 3 c, abcba, bbcbb. 


Can we find a PDA that accepts L? 
Idea: Memorise w-part using the stack, and use it to check for wF. 


Take: T = (A, BY, and Q,6, F as follows: 


a, A/A a, A/A 
b,A/B b, B/A 


o — O 
start qo 


Example computations ... 
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Pushdown Automaton Transitions 


a, A/B 
normal transition: 


e can be taken if: next input symbol is a, stack top is A 
e actions: read a from word, pop A, push B 


13/31 iCIS | Software Science 
Radboud University 


Pushdown Automaton Transitions 


a, A/B 
normal transition: 
a, A/A 


e can be taken if: next input symbol is a, stack top is A 
e actions: read a from word, pop A, push-& 
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Pushdown Automaton Transitions 


a, A/B 
normal transition: 
a, A/A 
a, A/B 
only push: 


e can be taken if: next input symbol is a, staektepis4 
e actions: read a from word, pep—4, push B 


13/31 iCIS | Software Science 
Radboud University 


Pushdown Automaton Transitions (cont'd) 


a, A/A 
ignore stack: 


e can be taken if: next input symbol is a 


e actions: read a from word 
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Pushdown Automaton Transitions (cont'd) 


a, A/A 
ignore stack: 

A,A/B 
ignore word: 


e can be taken if: stack top is A 


e actions: pop A, push B 
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Pushdown Automaton Transitions (cont'd) 


a, A/A 
ignore stack: 
A,A/B 
ignore word: 
A,A/A 
ignore everything: 


e can be taken: any time 
e actions: do nothing 
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Pushdown Automaton Transitions (cont'd) 


a, A/A 
ignore stack: 
A,A/B 
ignore word: 
A,A/A 
ignore everything: 
OF@Q OO 


14/31 iCIS | Software Science 
Radboud University 


Remarks on PDA Transitions 


a,A/B 
e Note: does not mean that the stack must be 


empty to take the transition. 


a, A/A 
e Note: does not mean that the stack is empty 


after the transition. 
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Variations on PDAs 


e Acceptance criteria: 
— Acceptance by final state and empty stack (our def.) 
— Acceptance by final state (only) 
— Acceptance by empty stack (only) 
All are equivalent (accept same class of languages). 
e A PDA is deterministic if for any combination of state, input symbol 
and stack top, there is at most one transition possible. 


a,A/A a, A/A 
a,A/A b, A/A b, A/B b, B/A 
o b, A/A A, A/À 
start start qo 
deterministic nondeterministic 
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Deterministic Context-Free Languages 


Def. A language is called deterministic context-free if there exists a 
deterministic PDA M with L = £(M). 


Examples of deterministic CFLs: 

e = {a"b” | n> 0} 

e = {wew® | we {a, b}*} 

Examples of CFLs that are not deterministic: 

e = {ww® | we fa, b}*} 

e {w €{a,b}* | w = w') (palindromes) 

Note: L is deterministic CFL implies L is unambiguous, 


but there are unambiguous CFLs that are not deterministic 
(e.g., palindromes). 
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Context-Free Languages and PDAs 


Last lecture: From regular grammar G to NFA) Me. 
Now: From context-free grammar G to PDA Mg. 
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Pushing words 


e First, some notation (multiple push): 


a, A/BC a,A/C n AXAJB 
Q (= 


(av, p, Aw) > (v, q, BCw) 


e  ..which generalises to words: 


A 
Q a, A/w (2) := (push w in reverse order) 


(av, p, Aw’) 2 (v. q, ww) 
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From CFG to PDA 


Ideas: 
e Put non-terminals on the stack, | = V 


e Ensure that rules are of the form X — aw or X > w, with w € V*. 
This can always be done. 


e Use one interesting, accepting, state q, plus more for pushing. 
e (q,Ww,v) = (q,A, À) in the PDA iff v = w in the CFG 
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From CFG to PDA (cont.) 


Initially push S onto the stack, 


A, A/S 
start (æ) / 


For each production rule X — aw, add 


OS 


For each production rule X — w, add 


(so xxi 
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From CFG to PDA, example 


S > aSb| T 
T — A|Tb 
This is not of the right form (because of the 5), change it to 
S — aSB|T 
T — A|TB 
B > b 
This gives the PDA 
a, S/SB 
, A/S A,S/T 
start (æ) A, T/A 
A, T/TB 
b, B/A 
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From a PDA to a CFG 


Ideas: 


Each push of X must have a matching pop of X. 
Split pushes and pops: 


© a X/Y O (>) a,X/r oO A,A/Y © 


Just three types of transitions remain: 


a, A/X X/A KA 


(where a can be A, and p might equal q). 
Take V = (Q x Q)U {S}. 
(p, r) => w iff (p,w, A) => (r, A, A). 
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From a PDA to a CFG (cont.) 


How can (p, w, A) = (r, A, A)? Either: 


(p) 29 a) —(0) 


new production: (p,r) — a(p',r) 


or: 


© a,A/X O u (a) b, X/A (4) u © 


new production: (p,r) — a(p',q)b(q',r) 
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From a PDA to a CFG (cont.) 


Production rules, for pairs of states (p, r): 


(pr) > a(p’,r) for every 


a, A/A 
O) 


(p,r) > a(p’,q)b(q',r) for every X, 


a, A/X 
OO 


(qq) > A for every qE Q 
—  (qo.q) for every qc F 
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Beyond context-free languages 


D 


One stack ~ "PDAs can only remember one thing at a time 


Examples of languages that are not context-free: 


e = [a"b"a"b"| n,m > 0} 
e ={a"b"c” | n> 0} 
e {w€ {a, b}* | |w| is prime number} 


(Prove using pumping lemma for CFLs) 
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Closure properties of context-free languages 


If Lı and Lo are context-free languages, 


then so are: but, in general, NOT 
e [iU L (union), e L; (complement), 
e lil» (concatenation), e 11 L (intersection). 


e Li (star), 


e LẸ (reversal) 


Deterministic CFLs are closed under complement, but NOT under union. 
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Questions about context-free languages 


Decidable (general algorithm exists) 


e Given any CFG G and w € 2%, is w € L(G)? 
(build PDA). 


e Given PDA M, is £(M) = 0? 
e Given PDA M, is C(M) finite? 
e Given any CFG G, is £(G) regular? 


Undecidable (no general algorithm exists) 

e Given any CFG G, is L(G) = X*? 

e Given any CFGs G and Gp, is £(G,) = L(G)? 
e Given any CFG G, is £(G) deterministic? 

e Given any CFG G, is it ambiguous? 
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Summary 


° Context-free grammars generate context-free languages. 
e All regular languages are context-free, but not vice versa. 
e Context-free languages are accepted by PDAs. 


e PDAs cannot be determinised (no subset construction) 
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